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TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND 
PROGRAM FOR IMPLEMENTING THE METHOD 

5 

BACKGROUND QF THE INVENTION 

Field of the invention 

[0001] The present invention relates to a technique of 
10 recording and playing back a digital image using a digital 

device having a capability of treating a digital image, such 
as a digital camera, a scanner, a printer, or a PC (personal 
computer) . 

D es cri ption of the Rela t ed Art 

15 [0002] The Exif (Exchangeable Image Fie Format) is widely 

used as a format for use by an image recording apparatus 
such as a digital camera to record a digital image file. In 
the Exif format, a main image, a sub image (in the form of a 
thumbnail image), and image attribute information such as 

20 picture -taking information are recorded in a predetermined 

form. 

[0003] Fig. 2 shows a data structure of a file in the 
Exif format. As shown in Fig. 2, image attribute 
information is described in a directory named IFD in a tree 
25 directory structure. In the Exif format, it is allowed for 
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a digital camera maker to describe its own IFD information 
between MakerNote tags in an Exif IFD area. 

[0004] For example, Japanese Patent Laid-Open No. 2000- 
261756 discloses a technique of writing compressed sub image 
5 data in a file using MakerNote tags. 

[0005] It is also known in the art to describe 
information (print commands), necessary to achieve color 
matching among devices, using MakerNote tags, thereby making 
it possible to print a high-quality image. By using print 
10 commands, it is possible to make various settings in terms 

of, for example, "brightness in printing", "color space", 
"contrast", "color saturation", "sharpness", and "memory 
color" . 

[0006] As described above, MakerNote tags can be used to 
15 describe various kinds of information in a specific area in 

a file so that the information makes the file more valuable 
in transferring, evaluating, playing back, and/or printing 
the image. 

[0007] Because any maker is allowed to freely describe 
20 image attribute information using MakerNote tags in 

accordance with the definition made by the maker, there is a 
possibility that different types of image attribute 
information are described depending on the functions and/or 
performance of digital cameras, even for digital cameras 
25 produced by the same maker. For example, even for digital 
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cameras produced by the same maker, the functions and the 
performance are improved from one generation to next, and 
the number of types of image attribute information is 
increased with increasing improvement in the functions and 
5 performance. This results in a great increase in the data 

size of image attribute information. 

[0008] In order to support playback of image files 
produced using old- generation digital cameras, it is 
required to analyze image attribute information which is no 
10 longer used in present-generation digital cameras. This 

causes an increase in the program size of firmware of 
digital cameras and related devices . 

[0009] In particular, supporting of attribute information 
which is used only in particular limited models of digital 
15 cameras causes other models of digital cameras to have to 

deal with such attribute information. This causes a large 
load to be imposed on design. 

[0010] If information associated with know-how possessed 
by a maker or attribute information indicating a particular 
20 characteristic of a particular model of digital camera is 

described together with image data, other makers can easily 
know what technology the maker uses . This causes a large 
risk that the technology is stolen by other makers, although 
this is convenient for users to record and reuse images . 
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SUMMARY OF THE INVENTION 



[0011] It is an object of the present invention to solve 
all or at least one of the problems described above, 
5 [0012] More specifically, it is an object of the present 

invention to provide an image processing apparatus , an image 
processing method, and a program for implementing the image 
processing method, having a capability of recording/playing 
back a digital image wherein the capability can be extended 

10 without a significant increase in load imposed on software. 

[0013] To achieve the above object, the present invention 
provides an image processing apparatus comprising recording 
means for storing an image file including an image area for 
storing image data and also including an attribute area for 

15 storing attribute information, description means for 

describing the attribute information using a tag defined by 
a tag-definable markup language, and writing means for 
writing the attribute information described by the 
description means into an arbitrary attribute area. 

20 [0014] The invention also provides an image processing 

apparatus comprising recording means for storing an image 
file including an image area for storing image data and also 
including an attribute area for storing attribute 
information, description means for describing the attribute 

25 information using a tag defined by a tag-definable markup 



language, encryption means for encrypting part or all of the 
attribute information described by the description means, 
and writing means for writing the attribute information 
encrypted by the encryption means into an arbitrary 
attribute area. 

[0015] The present invention also provides an image 
processing apparatus comprising recording means for storing 
an image file including an image area for storing image data 
and also including an attribute area for storing attribute 
information, description means for describing the attribute 
information using a tag defined by a tag-definable markup 
language, compression means for compressing part or all of 
the attribute information described by the description means, 
and writing means for writing the attribute information 
compressed by the compression means into an arbitrary 
attribute area. 

[0016] The present invention also provides an image 
processing apparatus comprising recording means for storing 
an image file including an image area for storing image data 
and also including an attribute area for storing attribute 
information, description means for describing the attribute 
information using a tag defined by a tag-definable markup 
language, encryption-and-compression means for encrypting 
and compressing part or all of the attribute information 
described by the description means, and writing means for 
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writing the attribute information encrypted and compressed 
by the encrypt ion -and- compression means into an arbitrary 
attribute area. 

[0017] The present invention also provides an image 
5 processing method comprising the steps of storing an image 

file including an image area for storing image data and also 
including an attribute area for storing attribute 
information, describing the attribute information using a 
tag defined by a tag-definable markup language, and writing 
10 the attribute information described in the description step 

into an arbitrary attribute area. 

[0018] The present invention also provides an image 
processing method comprising the steps of storing an image 
file including an image area for storing image data and also 

15 including an attribute area for storing attribute 

information, describing the attribute information using a 
tag defined by a tag-definable markup language, encrypting 
part or all of the attribute information described in the 
description step, and writing the attribute information 

20 encrypted in the encryption step into an arbitrary attribute 

area. 

[0019] The present invention also provides an image 
processing method comprising the steps of storing an image 
file including an image area for storing image data and also 
25 including an attribute area for storing attribute 
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information, describing the attribute information using a 
tag defined by a tag-definable markup language, compressing 
part or all of the attribute information described in the 
description step, and writing the attribute information 
5 compressed in the compression step into an arbitrary 

attribute area. 

[0020] The present invention also provides an image 
processing method comprising the steps of storing an image 
file including an image area for storing image data and also 

10 including an attribute area for storing attribute 

information, describing the attribute information using a 
tag defined by a tag-definable markup language, encrypting 
and compressing part or all of the attribute information 
described in the description step, and writing the attribute 

15 information encrypted and compressed in the encryption-and- 

compression step into an arbitrary attribute area. 
[0021] The present invention also provides a program for 
causing a computer to execute a procedure comprising the 
steps of storing an image file including an image area for 

20 storing image data and also including an attribute area for 

storing attribute information, describing the attribute 
information using a tag defined by a tag-definable markup 
language, and writing the attribute information described in 
the description step into an arbitrary attribute area. 

25 [0022] The present invention also provides a program for 
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causing a computer to execute a procedure comprising the 
steps of storing an image file including an image area for 
storing image data and also including an attribute area for 
storing attribute information, describing the attribute 
5 information using a tag defined by a tag-definable markup 

language, encrypting part or all of the attribute 
information described in the description step, and writing 
the attribute information encrypted in the encryption step 
into an arbitrary attribute area. 
10 [0023] The present invention also provides a program for 

causing a computer to execute a procedure comprising the 
steps of storing an image file including an image area for 
storing image data and also including an attribute area for 
storing attribute information, describing the attribute 
15 information using a tag defined by a tag-definable markup 

language, compressing part or all of the attribute 
information described in the description step, and writing 
the attribute information compressed in the compression step 
into an arbitrary attribute area. 
20 [0024] The present invention also provides a program for 

causing a computer to execute a procedure comprising the 
steps of storing an image file including an image area for 
storing image data and also including an attribute area for 
storing attribute information, describing the attribute 
25 information using a tag defined by a tag-definable markup 
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language, encrypting and compressing part or all of the 
attribute information described in the description step, and 
writing the attribute information encrypted and compressed 
in the encryption-and-compression step into an arbitrary 
5 attribute area. 

[0025] The present invention also provides an image 
processing apparatus comprising reading means for reading, 
from recording means, an image file including an image area 
for storing image data and also including an attribute area 

10 for storing attribute information, separation means for 

separating image data and attribute information included in 
the stored image file, and extraction means for extracting 
attribute information by analyzing the attribute information 
separated by the separation means in accordance a 

15 predetermined display style. 

[0026] The present invention also provides an image 
processing method comprising the steps of reading, from 
recording means, an image file including an image area for 
storing image data and also including an attribute area for 

20 storing attribute information, separating image data and 

attribute information included in the stored image file, and 
extracting attribute information by analyzing the attribute 
information separated in the separation step in accordance a 
predetermined display style. 

25 [0027] The present invention also provides a program for 
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causing a computer to execute a procedure comprising the 
steps of reading, from recording means, an image file 
including an image area for storing image data and also 
including an attribute area for storing attribute 
5 information, separating image data and attribute information 

included in the stored image file, and extracting attribute 
information by analyzing the attribute information separated 
in the separation step in accordance a predetermined display 
style. 

10 [0028] Further objects, features and advantages of the 

present invention will become apparent from the following 
description of the preferred embodiments with reference to 
the attached drawings. 

15 BRIEF DESCRIPTION OF THE DRAW IN G S 

[0029] Fig. 1 is a block diagram showing an image 
processing apparatus according to a first embodiment of the 
present invention . 
20 [0030] Fig. 2 is a diagram showing an internal structure 

of a Exif file. 

[0031] Fig. 3 is a table indicating the meanings of 
marker segment symbols shown in Fig. 2. 
[0032] Fig. 4 is a diagram showing a hierarchical 
25 structure of a IFD. 



[0033] Fig. 5 is a diagram showing a manner in which 

attribute information is processed when an image file is 

produced according to the first embodiment . 

[0034] Fig. 6 is a diagram showing an example of a XML 

file in which attribute information of an image file is 

described. 

[0035] Fig. 7 is a diagram showing a manner in which 

attribute information is processed when an image file is 

played back according to the first embodiment. 

[0036] Fig. 8 is a diagram showing a manner in which 

attribute information is processed when an image file is 

produced according to a second embodiment . 

[0037] Fig. 9 is a diagram showing a manner in which 

attribute information is processed when an image file is 

played back according to the second embodiment . 

[0038] Fig. 10 is a diagram showing a manner in which 

attribute information is processed when an image file is 

produced according to a third embodiment . 

[0039] Fig. 11 is a diagram showing a manner in which 

attribute information is processed when an image file is 

played back according to the third embodiment. 

[0040] Fig. 12 is a diagram showing a manner in which 

attribute information is processed when an image file is 

produced according to a fourth embodiment . 

[0041] Fig. 13 is a diagram showing a manner in which 
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attribute information is processed when an image file is 
played back according to the fourth embodiment . 

DE SCRIPTION OF THE PREFERRED EMBODIMENTS 
5 [0042] The present invention is described in further 

detail below with reference to preferred embodiments in 
conjunction with the accompanying drawings . 

Fiyst Embodiment 

10 [0043] Fig. 1 shows a construction of an image processing 

apparatus 100 according to a first embodiment of the present 
invention. 

[0044] As shown in Fig. 1, the image processing apparatus 
100 includes a zoom lens system 10, a focus lens system 11, 

15 a shutter 12 having a capability of also acting as an 

aperture, an imager device 14 for converting an optical 
image into an electric signal, and sensitivity adjuster 15 
for adjusting the sensitivity of the imager device 14. 
[0045] A A/D converter 16 converts an analog signal 

20 output from the imager device 14 into a digital signal. 

[0046] A timing generator 18 supplies a clock signal or a 
control signal to the imager device 14, the A/D converter 16, 
and a D/A converter 26, under the control of a memory 
controller 22 and a system controller 50. 

25 [0047] The zoom ratio of the zoom lens system 10 can be 
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set to one of nine values defined within the range from a 
wide-angle end to a close-up end, inclusive. 
[0048] An image processor 20 performs image processing 
such as pixel interpolation and/or color conversion on data 
5 output from the A/D converter 16 or the memory controller 22. 

The image processor 20 performs a particular calculation for 
given image data. In accordance with the result of the 
calculation, the system controller 50 automatically adjusts 
focus, exposure, and lighting based on the TTL ( through- the- 

10 lens) technique, by controlling the automatic exposure 

controller 40 and the focus controller 42. The image 
processor 20 further performs a particular calculation for 
the given image data to automatically adjust white balance 
using the TTL technique. 

15 [0049] The memory controller 22 controls the A/D 

converter 16, the timing generator 18, the image processor 
20, an image memory 24, the D/A converter 26, the memory 30, 
and a compression/decompression circuit 32. 
[0050] The data output from the A/D converter 16 is 

20 written via the image processor 20 or directly into the 

image memory 24 or the memory 30 under the control of the 
memory controller 22. 

[0051] The image data written in the image memory 24 is 
supplied to the display unit 28 such as a TFTLCD (Thin Film 
25 Liquid Crystal Display) via the D/A converter 26. The 



14 - 



display unit 28 displays an image in accordance with the 
received data. An electronic viewfinder is realized by 
continuously taking an image and displaying image data 
thereof on the display unit 28. The display unit 28 is 
5 turned on/off in accordance with a command issued by the 

system controller 50. If the display unit 28 is turned off, 
the power consumption of the image processing apparatus 100 
is greatly reduced. 

[0052] The memory 30 is used to store data of a taken 

10 still image or a moving image. The memory 30 has a storage 

capacity high enough to store a predetermined number of 
still images or a moving image with a predetermined length 
of time. The high storage capacity of the memory 30 makes 
it possible to realize a continuous shooting mode in which a 

15 large number of still images are successively taken and 

stored in the memory 30 and also a panorama mode in which a 
large number of still images are also taken. The memory 30 
may also be used as a work area for the system controller 50. 
[0053] The compression/decompression circuit 32 

20 compressed and decompressed image data by means of adaptive 

discrete cosine transformation (ADCT) or a similar technique. 
The compression/decompression circuit 32 reads image data 
from the memory 30 and compresses or decompressed the image 
data. The resultant data is rewritten into the memory 30. 

25 [0054] The automatic exposure controller 40 can also 
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serve as a flash light controller by controlling the flash 
lamp 48 in conjunction with the sensitivity adjuster 15, the 
shutter 12 having the capability of also acting as an 
aperture, and an electronic shutter controller for 
controlling the storage time from the end of sweeping out of 
the charge in the imager device 14 and to the start of 
reading image data. 

[0055] The focus controller 42 controls the focus of the 
focus lens 11. The zoom controller 44 controls the zoom 
ratio of the zoom lens 10. The barrier controller 46 
controls the operation of a barrier serving as protection 
means 102. 

[0056] The flash lamp 48 has the capability of emitting 
auxiliary light in the auto focus adjustment and providing 
effect light. 

[0057] The exposure controller 40 and the focus 
controller 42 are controlled in the through- the -lens manner 
by the system controller 50 in accordance with the result of 
the calculation performed on a taken image by the image 
processor 20 . 

[0058] The system controller 50 controls the entire image 
processing apparatus 100. Constants, variables, and 
programs used by the system controller 50 are stored in a 
memory 52. A display unit 54 displays information 
indicating the operating status or other messages using 
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characters, images, and/or voice, in accordance with a 
program executed by the control of the system controller. 
The display unit 54 includes a LCD (liquid crystal display), 
a LED (Light Emitting Diode), and a sound generator such as 
a speaker. The display unit 54 is disposed on the image 
processing apparatus 100 at a position near the operation 
control unit such that a user can easily view the display 
unit 54. Two or more image processing apparatuses 100 may 
be disposed, as required. Some functions of the display 
unit 54 are available on the optical viewfinder 104. 
[0059] Of various items displayed on the display unit 54, 
the following are displayed on the LCD: indication of 
single/successive- shot mode; indication of long-exposure 
mode; indication of night scene mode; indication of self- 
timer mode; indication of compression ratio; indication of 
resolution expressed in the number of pixels; indication of 
the number of taken pictures ; indication of the number of 
pictures allowed to be further taken; indication of shutter 
speed; indication of f -number; indication of exposure 
correction; indication associated strobe; indication of red- 
eye correction mode (a red-eye mode lamp is lit); indication 
of elapsed time (since last shooting); indication of macro 
mode; indication of beeper setting; indication of remaining 
capacity of clock battery; indication of remaining battery 
capacity; indication of error; indication of information 
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using a plurality of digits; indication of whether storage 
medium 200 or 210 is mounted; indication of the operation 
status of communication interface; and indication of 
date/time. Of items displayed on the display unit 54, the 
5 followings are displayed on the optical viewfinder 104: 

indication associated with focus; alarm of camera shakes- 
indication of status of flash charging; indication of 
shutter speed; indication of f -number; and indication of 
exposure correction . 
10 [0060] The memory 56 is of nonvolatile type capable of 

electrically erasing and writing data. For example, a 
EEPROM (Electrically Erasable and Programmable ROM) is used 
as the nonvolatile memory 56. 

[0061] Operation control means 60, 62, 64, 66, 68, and 70 
15 are used to input commands to the system controller 50 to 

specify operation conditions or modes. They are constructed 
in the form of a switch, a dial, a touch panel, a view- 
direction- sensitive pointing device, a voice recognition 
device, or a combination thereof. Each operation control 
20 means 60 is described below. 

[0062] The operation control means 60 is in the form of a 
mode dial switch and is used to selectively specify one of 
the followings functions/modes: power-off; automatic mode; 
picture- taking mode; panorama mode; playback mode; 
25 multiscreen playback/erase mode; and PC-connected mode. 
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[0063] The operation control means 62 is a shutter switch 
SW1. If a shutter button (not shown) is pressed down to a 
half -position, the shutter switch SW1 is turned on. In 
response, the automatic focus control, the automatic 
5 exposure control, and the light control are started. 

[0064] The operation control means 64 is a shutter switch 
SW2 which is turned on when the shutter button (not shown) 
is fully pressed down. If the shutter switch SW2 is turned 
on, a sequential process, including the following steps, is 

10 started: an exposure step of reading a signal from the 

imager device 12 and writing the signal as image data into 
the memory 30 via the A/D converter 16 and the memory 
controller 22; a developing step by performing a calculation 
using the image processor 20 and the memory controller 22; 

15 and a recording step of reading the image data from the 

memory 30, compressing the image data using the 
compression/decompression circuit 32, and writing the 
resultant image data into the storage medium 200 or 210. 
[0065] The operation control means 66 is an image display 

20 on/off switch for turning on/off the display unit 28. If 

this switch is turned off thereby turning off the power to 
the display unit 28 formed of a TFTLCD or the like, and if a 
picture is taken using the optical viewfinder 104 without 
using the display unit 28, the power consumption is reduced. 

25 [0066] The operation control means 70 is an operation 
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control unit including a touch panel and operation control 
buttons such as a menu button, a set button, a macro/non- 
macro switch button, a next /previous page button in the 
multiscreen playback mode, a flash setting button, a 
switching button for selecting a single shot mode, a 
snapshot mode, a self -timer mode, a slow shutter mode, or a 
night scene mode, a move menu forward button, a move menu 
reverse button, a playback next image button, a playback 
previous image button, a picture quality selection button, 
an exposure correction button, and a date/time setting 
button. 

[0067] A power controller 80 includes a battery detector, 
a DC-DC converter, and a switch for selecting a block to 
which to supply power. The power controller 80 detects 
whether a battery is mounted. If the battery is mounted, 
the power controller 80 detects the type of the battery and 
the remaining battery capacity. Depending on the detection 
result and under the control of the system controller 50, 
the power controller 80 controls the DC-DC converter to 
supply a necessary voltage to various parts including the 
storage medium for a necessary period time. In Fig. 1, 
reference numerals 82 and 84 denote connectors. Reference 
numeral 86 denotes a power supply such as a primary battery 
(for example, an alkaline battery or a lithium- ion battery), 
a secondary battery (for example, a Ni-Cd battery, a Ni-MH 



- 20 - 



battery, or a Li battery), or a AC adapter. 
[0068] Interfaces 90 and 94 serve to interface with a 
storage medium such as a memory card or a hard disk. 
Connectors 92 and 96 are used for making a connection with a 
5 storage medium such as a memory card or a hard disk. A 

storage medium detector 98 detects whether a storage medium 
200 or 210 is connected to the connector 92 or 96. In the 
present embodiment, there are provided two interfaces and 
two connectors so that two storage media can be connected. 

10 The number of interfaces and the number of connectors for 

connection with storage media are not limited to two, but 
there may be provided one, three, or a greater number of 
interfaces and connectors. When there are provided two or 
more combinations of an interface and a connector, they may 

15 be different in specifications from each other so as to 

connect different type storage media. The interfaces and 
the connectors may be selected so as to connect with a 
PCMCIA (Personal Computer Memory Card International 
Association) card, a CF (Compact Flash (trademark) card, or 

20 a SD (Source Digital) card. 

[0069] In the case in which the interfaces 90 and 94 and 
the connectors 92 and 96 are based on the PCMCIA card 
standard, the CF card standard, or the SD card standard, if 
a communication card such as a LAN (Local Area Network) card, 

25 a modem card, a USB (Universal Serial Bus) card, a IEEE1394 
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card, a P1284 card, a SCSI (Small Computer System Interface) 
card, or a PHS (Personal Handyphone System) , it is possible 
to transmit image data and control data associated with the 
image data to a computer or a peripheral device such as a 
printer. 

[0070] The protection means 102 is a barrier with which 
the imager unit including the zoom lens 10 and the focus 
lens 11 of the image processing apparatus 100 is covered so 
that the imager unit is protected from being damaged or made 
dirty. 

[0071] The optical viewfinder 104 allows a picture to be 
taken without using the electrical viewfinder. Some of 
information items displayed on the display unit 54 are also 
displayed on the optical viewfinder 104. For example, the 
indication associated the focus, the indication of a camera 
shake alarm, the indication of the status of charge-up of 
the flash capacitor, the indication of the shutter speed, 
the indication of the f -number, the indication of the 
exposure correction, and the indication of the macro mode 
are displayed on the optical viewfinder 104. 
[0072] Communication means 110 provides a communication 
capability via a communication medium such as RS232C, USB, 
IEEE1394, P1284, SCSI, a modem a LAN, or a wireless 
communication . 

[0073] A connector 112 is used to connect the image 
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processing apparatus 100 with another device via the 
communication means 110. In the case in which the 
communication means 110 is based on a wireless communication 
technique, the connector 112 is an antenna. 
5 [0074] The storage medium 200 is a memory card or a hard 

disk, including a storage unit 202 such as a semiconductor 
memory or a magnetic disk, an interface 204 for interfacing 
with the image processing apparatus 100, and a connector 206 
for connecting with the image processing apparatus 100. 

10 [0075] The storage medium 210 is a memory card or a hard 

disk, including a storage unit 212 such as a semiconductor 
memory or a magnetic disk, an interface 214 for interfacing 
with the image processing apparatus 100, and a connector 216 
for connecting with the image processing apparatus 100. 

15 [0076] When an operation of taking a picture is completed, 

an image file is produced in an image file format such as a 
Exif format or a DCF format and stored into the storage 
medium 200 or 210. 

[0077] If the operation is switched from the picture - 
20 taking mode into the playback mode by operating the mode 

dial 70, the image file stored in the storage medium 200 or 
210 is read into the memory 30. Depending on the image file 
format, decompression is performed, if necessary, by the 
compression/decompression circuit 32, and necessary 
25 processing is further performed by the image processor 20. 
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The resultant image data is stored in the image memory 24. 
[0078] In accordance with attribute information of the 
file, the system controller 50 converts picture- taking 
information such as an exposure value and a picture- taking 
date and camera setting information such as setting in the 
picture -taking mode into character information indicating 
image attribute information. The character is then 
converted into font information and stored into the image 
memory 24. The image data written in the image memory 24 is 
supplied to the display unit 28 via the D/A converter 26. 
Thus, the image and the image attribute information are 
displayed on the display unit 28. 

[0079] The image file format Exif (which is an image file 
format for use by a digital still camera, established by 
JEIDA) used in the present embodiment is described below. 
[0080] The Exif format is based on the JPEG format 
( ISO/IEC10918-1) and additionally includes an application 
marker segment (APP1) in which to record image attribute 
information such as picture- taking information or a 
thumbnail image . 

[0081] Fig. 2 shows an internal data structure of a Exif 
file. 

[0082] In Fig. 2, the structure of the entire Exif image 
file is shown in an area T1-T2. As shown, this area T1-T2 
includes marker segments SOI, APP1, DQT, DHT, SOF, SOS, and 
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EOI. The Exif file includes those marker segments and 
compressed image data. Each of those marker segments is 
described in Fig. 3. 

[0083] Of those markers, SOI is first written and then 
5 APP1 is written immediately after SOI. When APP2 is written, 

it is written following APP1 . In the present embodiment, a 
APP2 marker is not written. DQT, DHT, DRI , and SOF are 
written in an arbitrary order after APP2 and before SOS. 
[0084] In an area T3-T4, the details of the APP1 marker 

10 segment are shown. In accordance with the JPEG standard, 

the APP1 marker segment has to be described within 64 Kbytes. 
[0085] In an area T10-T13, the main part of the attribute 
information of the APP1 marker segment is described. The 
attribute information is described in the TIFF (Tagged Image 

15 File Format) format including a file header. and two IFDs 

(Oth IFD and 1st IFD) . In the 0th IFD (area T11-T12), 
attribute information associated with a compressed image 
(main image) is described. In the 1st IFD (area T12-T13), a 
thumbnail image may be written. 

20 [0086] The Oth IFD includes sub IFDs Exif IFD and GPS IFD. 

In the Exif IFD, image attribute information is written in 
accordance with the Exif standard. In the GPS IFD, the 
information associated with the location at which a picture 
is taken is described. 

25 [0087] The Exif IFD (area T5-T6) includes a maker note 
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IFD area (T20-T21) in which a maker is allowed to freely 
describe attribute information. 

[0088] Fig. 4 shows the hierarchical structure of the IFD. 
[0089] When an image file of a taken picture is produced 
5 or when an image file is read to play back a picture, image 

attribute information is processed in the manner described 
below. 

[0090] First, the manner is described in which image 
attribute information is processed when a picture is taken. 
10 [0091] Fig. 5 shows a flow of a process performed on 

attribute information when an image file is produced. This 
process is performed by the system controller 50 in 
accordance with a software program. 

[0092] In Fig. 5, on the basis of camera information 301 
15 and picture-taking information 302, a XML (Extensible Markup 

Language) generator 303 produces a XML file 304 to be 
written in a maker note area. 

[0093] Fig. 6 shows an example of the XML file 304. 
[0094] In the XML file 304, as shown in Fig. 6, each item 
20 of attribute information is described between a 

corresponding tag pair in accordance with the XML language 
format. For example, "On" is described between a tag 
" <Macro > " and a " < /Macro > " . 

[0095] Although in the present embodiment, image 
25 attribute information is described using the XML language. 
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image attribute information may be described using another 
tag-definable markup language. 

[0096] The produced XML file 304 is stored in the memory 
30 or the storage medium 200 or 210 shown in Fig. 1. 
5 [0097] Referring again to Fig. 5, the XML file 304 is 

input to a maker note generator 305. On the basis of the 
input XML file 304, the maker note generator 305 produces 
maker note data 306 including maker note IFD tags. 
[0098] The maker note data 306 is input together with 
10 picture- taking information 302 and camera information 301 to 

a Exif IFD generator 307 to produce Exif IFD data 308. 
[0099] Finally, the Exif IFD data 308 and compressed 
image data 311 are input to a Exif generator 309 to produce 
a Exif file 310. 

15 [0100] In this manner, a Exif file can be produced which 

includes a maker note area in which image attribute 
information is described in the XML language. 

[0101] The manner in which image attribute information is 
processed in playback operation is described below. 
20 [0102] Fig. 7 shows a manner in which attribute 

information is processed when an image file is played back. 
This process is also performed by the system controller 50 
in accordance with a software program. 

[0103] In Fig. 7, the Exif file 401 is separated by a 
25 Exif parser 402 into compressed image data and IFD 
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information. In the example shown in Fig. 7, Exif IFD data 

403 is extracted. 

[0104] The Exif IFD data 403 is input to Exif IFD parser 

404 to extract maker note data 405. 

5 [0105] The maker note data 405 is input to the maker note 

parser 406 to extract a XML file 407. 

[0106] The XML file 407 is input to the XML parser 408 to 
extract display data 409. Herein, if a style sheet 410 is 
also input together with the XML file 407 to the XML parser 

10 408, the display data 409 is produced in accordance with the 

layout rule specified by the style sheet 410 which defines 
the type of attribute information to be analyzed and the 
display style in which to display the attribute information 
on the display means. 

15 [0107] In this case, of various tags described in the XML 

file 407, only information associated with those tags 
described in the style sheet is analyzed, and the display 
data is produced in accordance with the result of the 
analysis . 

20 [0108] The display data 409 is output to the image 

display device and is displayed thereon. 

[0109] In this manner, the Exif file including the maker 
note area in which image attribute information is described 
in the XML language is played back and the attribute 
25 information is displayed. 
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[0110] Because only attribute information associated with 
tags specified in the style sheet is analyzed, the attribute 
information can be easily analyzed in a short time even when 
the original XML file includes a large amount of attribute 
5 information . 

Second Embodiment 

[0111] In this second embodiment, an image processor is 
similar in structure to that employed in the first 

10 embodiment, although it operates differently. That is, the 

image processor has a similar hardware structure to that 
according to the first embodiment described above with 
reference to Fig. 1, and thus a further detailed description 
thereof is not given herein. 

15 [0112] First, the manner is described in which image 

attribute information is processed when a picture is taken. 
[0113] Fig. 8 shows a flow of a process performed on 
attribute information when an image file is produced. This 
process is performed by the system controller 50 shown in 

20 Fig. 1 in accordance with a software program. 

[0114] In Fig. 8, on the basis of camera information 301 
and picture-taking information 302, a XML generator 303 
produces a XML file 304 to be written in a maker note area. 
[0115] The produced XML file 304 is stored in the memory 

25 30 or the storage medium 200 or 210 shown in Fig. 1. 
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[0116] The XML file 304 is input to the compression means 
320 to produce a compressed XML file 321. In the present 
embodiment, the compression means 320 is realized by means 
of software executed by the controller 50, although it may 
also be realized by means of hardware, 

[0117] The compressed XML file 321 is input to a maker 
note generator 305. On the basis of the input compressed 
XML file 321, the maker note generator 305 produces maker 
note data 306 including maker note IFD tags. 
[0118] The maker note data 306 is input together with 
picture- taking information 302 and cameral information 301 
to a Exif IFD generator 307 to produce Exif IFD data 308. 
[0119] Finally, the Exif IFD data 308 and compressed 
image data 311 are input to a Exif generator 309 to produce 
a Exif file 310. 

[0120] In this manner, the Exif file is produced which 
includes a maker note area in which image attribute 
information is described in a compressed form in the XML 
language . 

[0121] Now, the manner in which image attribute 
information is processed when an image file is played back 
is described. 

[0122] Fig. 9 shows a flow of a process performed on 
attribute information when an image file is played back. 
This process is also performed by the system controller 50 
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in accordance with a software program. 

[0123] In Fig. 9, the Exif file 401 is separated by a 
Exif parser 402 into compressed image data and IFD 
information. In the example shown in Fig. 9, Exif IFD data 
403 is extracted. 

[0124] The Exif IFD data 403 is input to a Exif IFD 
parser 404 to extract maker note data 405. 

[0125] The maker note data 405 is input to a maker note 
parser 406 to extract compressed XML file 420. 
[0126] The compressed XML file 420 is input to 
decompression means 421 to produce a XML file 407. The 
decompression means 421 serves to decompress data compressed 
by the compression means 320. In the present embodiment, 
the decompression means 421 is realized by means of software 
executed by the controller 50, although it may also be 
realized by means of hardware. 

[0127] The decompressed XML file 407 is input to the XML 
parser 408 to extract display data 409. Herein, if a style 
sheet 410 is also input together with the decompressed XML 
file 407 to the XML parser 408, the display data 409 is 
produced in accordance with the layout rule specified by the 
style sheet 410. 

[0128] The display data 409 is output to the image 
display device and is displayed thereon. 

[0129] In this manner, the Exif file including the maker 
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note area in which image attribute information is described 
in the compressed form in the XML language is decompressed 
and the attribute information is displayed. 

5 Third Embodiment 

[0130] In this third embodiment, an image processor is 
similar in structure to that employed in the first 
embodiment, although it operates differently. That is, the 
image processor has a similar hardware structure to that 
10 according to the first embodiment described above with 

reference to Fig. 1, and thus a further detailed description 
thereof is not given herein. 

[0131] First, the manner is described in which image 
attribute information is processed when a picture is taken. 
15 [0132] Fig. 10 shows a flow of a process performed on 

attribute information when an image file is produced. This 
process is performed by the system controller 50 shown in 
Fig. 1 in accordance with a software program. 

[0133] In Fig. 10, on the basis of camera information 301 
20 and picture-taking information 302, a XML generator 303 

produces a XML file 304 to be written in a maker note area. 

[0134] The produced XML file 304 is stored in the memory 

30 or the storage medium 200 or 210 shown in Fig. 1. 

[0135] The XML file 304 is input to encryption means 330 
25 to produce an encrypted XML file 331. In the present 
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embodiment, the encryption means 330 is realized by means of 
software executed by the controller 50, although it may also 
be realized by means of hardware. 

[0136] The encrypted XML file 331 is input to a maker 
note generator 305. On the basis of the input encrypted XML 
file 331, the maker note generator 305 produces maker note 
data 306 including maker note IFD tags. 

[0137] The maker note data 306 is input together with 
picture -taking information 302 and cameral information 301 
to a Exif IFD generator 307 to produce Exif IFD data 308. 
[0138] Finally, the Exif IFD data 308 and compressed 
image data 311 are input to a Exif generator 309 to produce 
a Exif file 310. 

[0139] In this manner, the Exif file including a maker 
note area in which image attribute information is described 
in an encrypted form in the XML language is produced. 
[0140] Now, the manner in which image attribute 
information is processed when an image file is played back 
is described. 

[0141] Fig. 11 shows a flow of a process performed on 
attribute information when an image file is played back. 
This process is also performed by the system controller 50 
in accordance with a software program. 

[0142] In Fig. 11, the Exif file 401 is separated by a 
Exif parser 402 into compressed image data and IFD 
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information. In the example shown in Fig. 11, Exif IFD data 
403 is extracted. 

[0143] The Exif IFD data 403 is input to a Exif IFD 
parser 404 to extract maker note data 405. 
5 [0144] The maker note data 405 is input to a maker note 

parser 406 to extract an encrypted XML file 430. 
[0145] The encrypted XML file 430 is input to decryption 
means 431 to produce a XML file 407. The decryption means 
431 serves to decrypt data encrypted by the encryption means 

10 330. In the present embodiment, the decryption means 431 is 

realized by means of software executed by the controller 50, 
although it may also be realized by means of hardware. 
[0146] The decrypted XML file 407 is input to the XML 
parser 408 to extract display data 409. Herein, if a style 

15 sheet 410 is also input together with the decrypted XML file 

407 to the XML parser 408, the display data 409 is produced 
in accordance with the layout rule specified by the style 
sheet 410. 

[0147] The display data 409 is output to the image 
20 display device and is displayed thereon. 

[0148] In this manner, the Exif file including the maker 
note area in which image attribute information is described 
in the encrypted form in the XML language is decrypted and 
the attribute information is displayed. 



25 
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Fourth E mbodiment 

[0149] In this fourth embodiment, an image processor is 
similar in structure to that employed in the first 
embodiment, although it operates differently. That is, the 
image processor has a similar hardware structure to that 
according to the first embodiment described above with 
reference to Fig. 1, and thus a further detailed description 
thereof is not given herein. 

[0150] First, the manner in which image attribute 
information is processed when a picture is taken is 
described. 

[0151] Fig. 12 shows a flow of a process performed on 
attribute information when an image file is produced. This 
process is performed by the system controller 50 shown in 
Fig. 1 in accordance with a software program. 

[0152] In Fig. 12, on the basis of camera information 301 
and picture -taking information 302, a XML generator 303 
produces a XML file A 351 and a XML file B 350 to be written 
in a maker note area. In the XML file A 351, information 
which is useful for users is described. For example, 
picture -taking information such as the f -number and the 
shutter speed or camera setting information such as settings 
in the picture- taking mode is described in the XML file A 
351. On other hand, in the XML file B 350, information 
which is not needed to be informed to users is described. 
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For example, information associated with adjustments made at 
factories is described herein. 

[0153] The XML file B350 is input to encryption means 330 
to produce an encrypted XML file 331. In the present 
5 embodiment, the encryption means 330 is realized by means of 

software executed by the controller 50 r although it may also 
be realized by means of hardware. 

[0154] The encrypted XML file 331 and the non-encrypted 
XML file 351 are input to a maker note generator 305. On 
10 the basis of the input files 331 and 351, the maker note 

generator 305 produces maker note data 306 including maker 
note IFD tags. 

[0155] The maker note data 306 is input together with 
picture-taking information 302 and camera information 301 to 
15 a Exif IFD generator 307 to produce Exif IFD data 308. 

[0156] Finally, the Exif IFD data 308 and compressed 
image data 311 are input to a Exif generator 309 to produce 
a Exif file 310. 

[0157] Thus, the Exif file is produced which includes the 
20 maker note area in which image attribute information 

described in the encrypted form in the XML language and 

image attribute information described in the non-encrypted 

form in the XML language are written. 

[0158] Now, the manner in which image attribute 
25 information is processed when an image file is played back 
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is described. 

[0159] Fig. 13 shows a flow of a process performed on 
attribute information when an image file is played back. 
This process is also performed by the system controller 50 
in accordance with a software program. 

[0160] In Fig. 13, the Exif file 401 is separated by a 
Exif parser 402 into compressed image data and IFD 
information. In the example shown in Fig. 13, Exif IFD data 
403 is extracted. 

[0161] The Exif IFD data 403 is input to a Exif IFD 
parser 404 to extract maker note data 405. 

[0162] The maker note data 405 is input to a maker note 
parser 406 to extract a XML file A 451 and an encrypted XML 
file 430. 

[0163] The encrypted XML file 430 is input to decryption 
means 431 to produce a XML file B 450. The decryption means 
431 serves to decrypt data encrypted by the encryption means 
330. In the present embodiment, the decryption means 431 is 
realized by means of software executed by the controller 50, 
although it may also be realized by means of hardware. 
[0164] The encrypted XML file and/or the XML file A may 
be compressed as in a previous embodiment, and they may be 
decompressed when an image is played back. This is 
desirable in that the data size can be reduced. 
[0165] The XML file A 451 and the decrypted XML file B 



450 are input to the XML parser 408 to extract display data 
409. Herein, if a style sheet 410 is also input together 
with the XML file A 451 and the decrypted XML file B 450 to 
the XML parser 408, the display data 409 is produced in 
accordance with the layout rule specified by the style sheet 
410. 

[0166] In this process, of various tags described in the 
XML file 407, only those tags specified in the style sheet 
are analyzed, and display data is produced in accordance 
with the result of the analysis. 

[0167] The display data 409 is output to the image 
display device and is displayed thereon. 

[0168] In the above process, only one of the XML file A 

451 and the XML file B 4 50 may be selectively input to the 
XML parser 408. For example, when the XML file B450 
includes no information necessary in displaying an image, it 
is desirable to input only the XML file A 451 to the XML 
parser 408. 

[0169] Thus, the Exif file including the maker note area 
in which image attribute information described in the 
encrypted form in the XML language and image attribute 
information described in the non-encrypted form in the XML 
language are written is decrypted and the image attribute 
information is displayed. 

[0170] In the above process, the XML parser 408 may 
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analyze only the non- encrypted XML file A without analyzing 
the encrypted XML file. 

[0171] This can be accomplished by executing a 
preinstalled program or by employing a style sheet which 
does not include an encrypted part . 

[0172] As a matter of course, the style sheet may also 
include attribute information included in the encrypted XML 
file. 

[0173] The encrypted XML file may advantageously used to 
describe secret information such as attribute information 
associated with a special model of digital camera, 
information associated with know-how a maker has, or 
attribute information indicating a particular characteristic 
of a particular model of digital camera, without causing the 
secret information to be easily read by other makers. 
[0174] It is more desirable that key information 
necessary to decrypt the encrypted XML file be described in 
the style sheet . 

[0175] This makes it possible to analyze attribute 
information only when the style sheet including the key 
information is used. In this case, only attribute 
information specified by the style sheet can be displayed, 
and thus special attribute information that the maker wants 
to keep secret can be protected. 

[0176] It is also desirable that a plurality of different 
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encryptions be applied to the XML file so that analyzable 
attribute information can be switched by selecting an 
encryption. 

[0177] In this case, only particular attribute 
information corresponding to a decryption key described in 
the style sheet can be decrypted, thereby making it possible 
to protect, in a more reliable manner, the attribute 
information that the maker wants to keep secret. 
[0178] In Figs. 5 to 13, the XML generator 303, the maker 
note generator 305, the Exif IFD generator 307, the Exif 
generator 309, the Exif parser 402, the Exif IFD parser 404, 
the maker note parser 406, the XML parser 408, the style 
sheet 410, the compression means 320, the encryption means 
330, the decompression means 421, and the decryption means 
431 are realized by means of software executed by the system 
controller 50. Those components can be realized as software 
components independently of each other. 

[0179] If those software components are installed not 
only in a digital cameral but also in another device such as 
a printer, a facsimile machine,, a scanner, or a personal 
computer, then it becomes possible for various different 
devices to treat image attribute information. 

[0180] If the communications means 110, the interfaces 90 
and 94 and the connectors 92 and 96 are formed according to 
the standard for PCMICA cards, CD cards, or SD cards, then 
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it is possible to transfer software components described 
above by means of downloading via a communication card such 
as a LAN card, a modem card, a USB card, a IEEE1394 card, a 
P1284 card, a SCSI card, or a PHS, connected to the 
connector 92 or 96. In this case, the downloaded software 
components are installed in the memory 30 or 52 or the 
storage medium 200 or 210. This makes it possible to 
replace an existing software component with a new software 
component, depending on the item of image attribute 
information, the format of information, and/or the layout of 
an image displayed on the display device. 

[0181] If two or more of software components are stored 
in the memory 30 or 52 or the storage medium 200 or 210, it 
becomes possible to selectively use those software 
components. This allows an improvement in convenience. For 
example, if a plurality of style sheets 511 are prepared as 
software components, it becomes possible for a user to 
select a desired one to display an image and associated 
image information according to the selected display layout. 
[0182] In the second embodiment described above, the XML 
file is compressed and decompressed, while the XML file is 
encrypted in the third and fourth embodiments. 
Alternatively, both compression and encryption may be 
applied to the XML file. That is, the Exif file may include 
attribute information described in a XML file in a 



compressed and encrypted form. 

[0183] The present invention may be applied to a system 
including a plurality of devices (such as a host computer, 
an interface device, a reader, and a printer) or may be 
applied to a single apparatus (such as an image display 
device, a printer, a copying machine, a facsimile machine). 
[0184] The objects of the present invention may also be 
achieved by supplying a storage medium, on which a software 
program implementing the functions of any of the embodiments 
described above is stored, to a system or an apparatus 
whereby a computer (CPU or MPU) in the system or apparatus 
reads and executes the program code stored on the storage 
medium . 

[0185] In this case, it should be understood that the 
program code read from the storage medium implements the 
functions of invention and thus the storage medium storing 
the program code falls within the scope of present invention. 
[0186] Storage media which can be preferably employed in 
the present invention to supply the program code include a 
floppy disk, hard disk, optical disk, magneto -optical disk, 
CD-ROM, CD-R, magnetic tape, non-volatile memory card, and 
ROM. The program code may be supplied from a server 
computer via a communication network. 

[0187] Furthermore, the scope of the present invention 
includes not only such a system in which the functions of 
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any embodiment described above is implemented simply by 
reading and executing a program code on a computer but also 
a system in which a part of or the whole of process 
instructed by the program code is performed using a OS 
5 (operating system) on the computer. 

[0188] Furthermore, the scope of the present invention 
also includes a system in which a program code is 
transferred once from a storage medium into a memory 
provided in a function extension board inserted in a 

10 computer or provided in a function extension unit connected 

to the computer, and then a part of or the whole of process 
instructed by the program code is performed by a CPU or the 
like in the function extension board or the function 
extension unit thereby implementing the functions of any 

15 embodiment described above. 

[0189] As described above, by describing image attribute 
information in a tag-definable markup language and storing 
it in a file, it becomes possible to easily analyze the 
information and display it regardless of what is described 

20 in the image attribute information. 

[0190] Furthermore, by realizing the generator for 
producing various data and the parser for analyzing the data 
in the form of software components, it becomes possible to 
transfer software components thereby easily changing the 

25 means for analysis and display. 
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[0191] Furthermore, it also becomes possible for various 
different devices to deal with image files including image 
attribute information described in various different formats, 
without causing an increase in the software size. 
[0192] Furthermore, it also becomes possible to easily 
achieve compatibility with old image file formats. 
[0193] Furthermore, the attribute information described 
in the XML language may be divided into an open part and a 
concealed part, and only information such as picture- taking 
information which should be provided to users may be 
described in the open part, while information (for example, 
values adjusted in factories) that makers want to keep 
secret may be described in the concealed part. 
[0194] Furthermore, it also becomes sufficient to analyze 
only particular attribute information, and thus it is 
possible to prevent an increase in load imposed on the 
apparatus even when the file includes a large amount of 
attribute information . 

[0195] While the present invention has been described 
with reference to what are presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims. The scope of 
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the following claims is to be accorded the broadest 
interpretation so as to encompass all such modifications 
equivalent structures and functions. 



